Conversation
…cipe Track recipes/Agentic-Kimi-K3.md as retuned in ROCm/ATOM#2382: enable FlyDSL FP8 prefill attention on every band, and hold a ready prefill for four decode passes from concurrency 16 up. The published concurrency set and every other launch argument are unchanged. 将 MI355X Kimi-K3 FP4 ATOM AgentX 提交切换到 0924 镜像，并跟随 ROCm/ATOM#2382 重调后的 recipe：全部并发开启 FlyDSL FP8 prefill attention；并发 16 及以上时让就绪的 prefill 等待 4 个 decode 轮次。 已发布的并发点集合与其余启动参数保持不变。 Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
gbyu-amd
requested review from
1am9trash,
billishyahao,
chunfangamd,
seungrokj and
yctseng0211
as code owners
September 24, 2026 07:44
gbyu-amd
added
AMD
agentx
Contributor
|
Thanks for the contribution!
中文感谢你的贡献！
|
将 perf-changelog 条目的 pr-link 指向 PR 3407。 Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
![claude[bot]](https://avatars.githubusercontent.com/in/1236702?s=60&v=4){kind=small}
Contributor
|
View unofficial run (performance): https://inferencex.semianalysis.com/inference?unofficialRun=36211860108 View unofficial run (accuracy): https://inferencex.semianalysis.com/evaluation?unofficialRun=36211860108 |
seungrokj
reviewed
Sep 26, 2026
…1613 Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
Collaborator
|
InferenceX has switched away from unmaintainable bash scripts to YAML files that don't repeat the same stuff over and over again. Please merge the latest |
Open
1 task
This branch has not been deployed
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
3 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Track the checked-in ATOM recipe
recipes/Agentic-Kimi-K3.mdas retuned in ROCm/ATOM#2382, on imagekimi_k3_agentic_0924.The published concurrency set [1, 4, 14, 16, 48, 56, 72] is unchanged; no points are added or dropped.
ATOM_USE_FLYDSL_FP8_PREFILL_ATTN=1on every band. ATOM defaults it to0, so the recipe's prefill attention path was not reached before this change.ATOM_PREFILL_DECODE_INTERVAL=4andATOM_PREFILL_DELAYER_MAX_QUEUE_MS=5000hold a ready prefill for four decode passes instead of interleaving it into every step. This is a threshold, not a band: concurrency 1, 4 and 14 run without it.max-num-seqs,max-num-batched-tokens,gpu-memory-utilization, the CUDA-graph ladder,dcp-size, draft depth, synthetic acceptance, ReplaySSM placement,AITER_REUSE_IDENTICAL_COMM_GROUPSand LMCache sizing are unchanged from #3207.Re-created on an in-repo
amd/branch so sweep dispatch and labels (AMD,agentx,full-sweep-enabled) apply.AI model disclosure
Prepared with Claude Code using
claude-opus-5(recipe reconciliation, edits, changelog entry). No other model contributed.